1 link tagged with all of: interpretability + deceptive ai + ai safety
Click any tag below to further narrow down your results
Links
Neel Nanda argues that interpretability research won't deliver high-reliability safety guarantees for superintelligent systems, even though the tools are still worth funding. He says it should be one layer in a defence-in-depth strategy, not the thing that saves us.
- Interpretability faces its own deep problems, such as superposition and imperfect tools, so it isn't obviously easier to trust than black-box testing.
- Nanda used to hold the view that interpretability is the most realistic path to reliable safeguards, and he now rejects it, calling it an isolated demand for rigor.
- Interpretability still helps in practice: for evaluations, cheap monitoring at inference time, and tricks like steering a model into thinking it isn't being tested.
- High reliability will likely require pre-superintelligent systems that are already aligned enough to do automated research or run oversight schemes.